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The following materials consist of a thematic selection from 
the International Conference “Information Visualisation” IV- 
2002 and an the accompanying “Symposium and Online Gal- 
lery of Digital Art, [V-Dart,” London, England. 


Information about 2003 events can be found at: 
http://www.graphicslink.demon.co.uk/IV03/. 
http://www.graphicslink.demon.co.uk/ITV03/GALLERY.htm. 


Deadlines for the IV 2004 and IV-Dart 2004 and information 
how to submit papers and artwork will be posted at: 
http://www.graphicslink.demon.co.uk/IV04/. 
http://www.graphicslink.demon.co.uk/ITV04/GALLERY.htm. 


Conference papers and information can be found in the Pro- 
ceedings, Sixth International Conference on Information 
Visualisation, Los Alamitos, CA: IEEE Computer Society, 
ISBN 0-7695-1656-4. Materials from previous IV Conferences, 
established and organized by Dr. Ebad Banissi and Programme 
& Organizing Committees in 1997, can be found in earlier Pro- 
ceedings. 


This Issue is mostly about Glyphs: single graphical units which 
are able to portray many variables by changing their proper- 
ties. An early example was developed by Chernoff who repre- 
sented multi-variable data through face expressions as a way 
of displaying interactive content. Thus by observing the shape 
of a glyph one can determine the quality and quantity of the 
links within a website. This issue is also about fillets: soft shapes 
for easily perceptible connections, and some educational 
projects as well. 


Tuomas J. Lukka, Janne V. Kujala and Marketta Niemela de- 
scribe Fillets: soft shapes for easily perceptible connections 
which are useful in tracing connections in graphs and compre- 
hending the structure and possibly the contents of the graphs. 
The semantic relationships in complicated diagrams of graphs 
(nodes connected by arcs) are usually drawn using boxes and 
lines between them, but this layout can be ambiguous. Fillets 
enable the fastest perception of connection going behind a node 
and can help perceiving the structure of node-link graphs and 
thus understanding their contents. 


Noritaka Osawa tells about visual and sound glyphs. Devel- 
oping immersive programming systems needs a 3D visualiza- 
tion of a program. The author believes that generating aestheti- 
cally attractive glyphs would help people understand the ab- 
stract relationships visually and audibly. The sound glyphs can 
be used simultaneously with other visual representations. He 
previously proposed and evaluated a generation method and 
use of 2D glyphs to represent inheritance relationships in ob- 
ject-oriented programming, and 3D diagrams composed of 
“Jigsaw-puzzle-like” glyphs to represent syntactical constraints 
in a context-free grammar. The author also proposes an 
auralization method for representing hierarchical inheritance 


relationships, which generates sound passages called “sound 
glyphs” (depicted in the form of notes ) for nodes in hierarchi- 
cal relationships or constraints. Different nodes at the same 
depth in this hierarchy are distinguished by melodies. 


Jonathan Roberts, Nadia Boukhelifa, Peter Rodgers have de- 
veloped a system that can visualize search-result data using 
glyphs and coordinated multiple-views. They stress a need for 
a web-search result visualization as the rank-ordered lists of 
search results allow the user view only a small proportion of 
the results in a single window. Some of the glyphs show the 
domain of the site of each webpage (with the addresses: .coun- 
try, .com, .edu, .org, or net mapped to triangle, circle, square, 
parallelogram, hexagon, plus-symbol, respectively), where the 
rank is allocated a color (with a brighter color representing a 
higher ranked entity) and the size of the page relates to the 
border-width of the glyph. Another glyph design is based on 
quartiles (with the use of color, placement, and concentric rings) 
and allowed to assign the quantities to the lower, median or 
upper quartile or represent the measure of external and inter- 
nal links of a site placement. 


Patrick Connolly and William A. Ross describe their endeav- 
ors in computer graphics instruction to develop graphical - vi- 
sual, spatial, audile, and motion-based assignments based on 
3D computer graphic design- simulation which enhance the 
understanding of the relationship between interacting physical 
objects and the mathematical and graphical fundamentals that 
describe that interaction. They describe the projects and pro- 
vide examples of student solutions 


Par-Anders Albinsson and Magnus Morin apply the Attribute 
Explorer, an interactive data presentation tool that employs the 
concept of linked histograms to a military application. The 
color-coded histograms help to visually explore the data sets 
and navigate among process-tracing data. Map views synchro- 
nized to the Attribute Explorer show how the units were situ- 
ated at the time. In another example, by selecting appropriate 
limits on the sender, receiver, classification, and time dimen- 
sion, the color-coding of the elements make military supervi- 
sion visually clear. 


Forum 


Math Made Visible 

Wednesday, March 10, 7:30 PM 

McBean Theater, The Exploratorium 
3601 Lyon St., San Francisco, CA 94123 


Math patterns, often intricate and even paradoxical, are beauti- 
ful in a way that keeps us interested. Each time we look we see 
more. The visual arts are also a way to illustrate the odd and 
wonderful aspects of math. This month's forum, "Math Made 
Visible" features Dr. Keith Devlin of Stanford, best known as 
"the Math Guy" on NPR and Mary Teetor, who embroiders 
mathematical patterns and Dr. Karl Schaffer, whose traveling 
dance troupe, "Dancing about Math with Dr. Schaffer and Mr. 
Stern" has made math concepts vivid to schoolchildren all over 
the country. 


More about the speakers: 

Dr. Keith Devlin, is "the Math Guy" who explains math to or- 
dinary people on NPR's "Weekend Edition." He is not only a 
mathematician, but an expert in How to Explain, being Execu- 
tive Director of Stanford University's Center for the Study of 
Language and Information. He is also a co-founder and Ex- 
ecutive Director of Stanford's Media X program, and a Con- 
sulting Professor of Mathematics at Stanford. His 24 books 
include two with color pictures that would dazzle artists. They 
are: Mathematics, the Science of Patterns (Scientific Ameri- 
can Library) and Life by the Numbers (John Wiley). One of 
his latest is: The Math Gene: How Mathematical Thinking 
Evolved, and Why Numbers are Like Gossip. He writes a 
monthly column, "Devlin's Angle," on the web journal MAA 
Online. Since 1983, he has written a regular column on math- 
ematics and computers for The Guardian newspaper in his na- 
tive Britain. 

http://www-csli.stanford.edu/~devlin/ 


Mary Teetor says she took up embroidery thirty-five years ago 
when she quit smoking. "I became intrigued with...drawn-fab- 
ric work, which pulls the threads of the fabric apart to create 
lacy patterns. Ten years ago, I combined the drawn-fabric work 
with tiling patterns to develop a new kind of embroidery, which 
I call tessellation-pattern shadow stitch." She worked within 
the constraints of three requirements: first, that the tessella- 
tions must be usable on the grid of a woven fabric; second, that 
there must be negative (unembroidered) as well as positive 
space in each tessellation; and third, that the polygons touch 
only at their apexes. Triangles, hexagons and even pentagons, 
she found, are possible on the square grid. Consulting several 
mathematics books, she has invented more than 400 patterns 
for the technique, of which she has stitched 50. 


Dr. Karl Shaffer, of MathDance with Dr. Schaffer and Mr. Stern, 
will show a video of performances the troupe has given across 
the country for school children and others. For three straight 
years it has received Education grants from the National En- 
dowment for the Arts. "Our math dance work grew from two 
seeds. As choreographers, much of our work springs from play 
with ideas from the world of mathematics. As teachers, we have 
found that mathematical ideas become more exciting, tangible 
and memorable when you act them out with your whole body." 
In collaboration with Scott Kim, a member of the troupe, 
Schaffer and Stern have published an idea book for teachers, 
MathDance with Dr. Schaffer and Mr. Stern 
http://www.mathdance.org and www.schafferstern.org. 


Aspects Of Generative Art 


On January 14, 2004, the topic of the bi-monthly YLEM Fo- 
rum at the Exploratorium was “Aspects of Generative Art”. 
“Generative Art” can be defined as art which brings itself into 
being as a result of processes set in motion by artists. Three 
Bay Area generative artists discussed their conceptions of this 
process and presented examples of their work. The artists were 
Loren Means, Scott Draves, and Aaron Ross. 


Loren Means is Executive Editor of the YLEM Journal. He is 


also a pioneer in self-generated film imagery, presenting his 
painted films at the F8 Filmmakers’ Cooperative’s 8mm Film 
Festival at Intersection in 1967, the first 8mm film festival ever 
held. Means has exhibited his work as featured artist in North- 
ern and Southern California and New York City. 


Means presented an overview of generative art in various me- 
dia throughout the last century, including examples of audio 
feedback by Jimi Hendrix, generative film by Stan Brakhage, 
video by Nam June Paik, and painting by Jackson Pollock and 
Helen Frankenthaler. He also presented self-generated com- 
puter environments by Marius Johnston and Germany’s Guenter 
Bachelier. He also showed an example of his own film work, 
utilizing mass, light modulation, reflection, color, focus, and 
distorting camera motion. The combination of these factors 
produced shapes that were not present in the real world, and 
were not visible to the naked eye. They also produced an am- 
biguity between two- and three-dimensional spatial location. 


Scott Draves is a software artist who produces visuals by writ- 
ing software. The end products of his work include digital prints, 
video, interactive systems, and web sites. The software has 
emergent properties, exhibits artificial life, and is distributed 
with an open source license. He has written software programs 
for the Web including Flame, an iterated function system, Fuse, 
a scrambled image system, Bomb, an interactive system, and 
Electric Sheep, a screen saver image generation system en- 
couraging the participation of other web artists. His Flame 
images were featured in Wired Magazine and received Best of 
Show commendation at the Art, Science, & Technology show 
at Artisans Gallery in Mill Valley in 2001. He has contributed 
two articles to the YLEM Journal. 


Aaron Ross works in several media, including writing, 3d com- 
puter modeling and animation, video and multimedia produc- 
tion, and audio and music generation. He is the co-author (with 
Michele Bousquet) of Harnessing 3ds Max 5, based on a series 
of Web tutorials. His video art has been screened at San Fran- 
cisco Cinematheque and at many prestigious festivals around 
the world, including SIGGRAPH, ISEA, Prix Ars Electronica, 
Berlin Interfilm, and at the Art Institute of California, where 
Ross is on the faculty of the Animation and Mutimedia depart- 
ments. Ross’ fractal image “Clear Light,” created using Scott 
Draves’ Flame algorithm, was exhibited at the Art, Science, & 
Technology show at Artisans Gallery in Mill Valley in 2001 
along with Draves’ Flame images, and the two artists met for 
the first time at the reception for that showing. 


News 
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We are developing a future exhibit which will focus on art- 
works that incorporate light. What do we mean by light? Well, 
either light or it's interaction is an integral part of the artwork. 
Our first step is to create a book of YLEM artists’ artworks for 
curators to review. If this fits you and you would like your 
work to be considered in the selection process please contact 
Barbara Lee at ylem@ylem.org for details. 
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Diagrams of graphs (nodes connected by arcs) are usually 
drawn using boxes and lines between them. Displaying rela- 
tionships between nodes by lines or arcs is efficient as physi- 
cal connection makes the nodes to be perceived as parts of a 
single object, according to the law of connectivity (one of the 
laws of perceptual organization). Therefore, the viewer needs 
no conscious effort to perceive the semantic relationship be- 
tween the nodes. For simple graphs, this is quite satisfactory, 
but when lines must cross each other and the graph is badly 
laid out, the boxes-and-lines drawings can actually be ambigu- 
ous. If the layout cannot be changed (or if that would lead to 
other complications), a rendering method which allows the 
viewer to distinguish between the different possibilities is 
needed. 


One possibility is a technique used in conventional ink draw- 
ing techniques where the lines that go behind an object do not 
actually touch the object. Even though this approach helps, it 
only allows a human to distinguish between the situations by 
focusing his/her attention to the point of the crossing. The lay- 
out does not "pop out" from the diagram: the connectivity is 
not preattentively perceived. 


Our solution is to soften the angular box-and-line shapes by 
using fillets in the rendering. Filleting, or rounding corners of 
surfaces, is used in mechanical engineering to improve the prop- 
erties of cast objects. Sharp corners are fragile and can also 
cause defects during molding. Filleting is an instance of a more 
general technique known as blending - creating surfaces that 
meet several existing surfaces smoothly. 


Fillets aim to enhance the perception of connectivity by imple- 
menting the connecting lines with continuity. The node and 
the connecting line form one object, without an abrupt disrup- 
tion in perception, thus making it easy to follow the connec- 
tion between nodes. Our use of fillets is entertainingly analo- 
gous to the use in mechanical engineering: fillets ensure that 
the human perception system doesn't break an object and a 
connection starting from it into two distinct objects. 


The filling of connections in graph diagrams conforms to the 
Gestalt principle of good continuation. Smoothly changing 
contours enable more efficient perceptual grouping of visual 
elements, in this case, grouping of the node and the connec- 
tion. 


The only disruptions in a fillet graph will be when the connec- 
tions cross each other. This makes a complex filleted graph 
that is far easier to read than a box-line graph, because in box- 
line graphs disruptions occur not only at line crossings but also 
where the lines connect to the boxes, making the two situa- 
tions hard to distinguish. With fillets, tracing a connection is 
perceptually easy even if it crosses with other connections. 


We tested the ease of perceiving fillets in a controlled labora- 


a) 


dj 


The basic idea of fillets in graph visualization. a) An inherently 
ambiguous graph diagram, which can mean either the structure in 
b) or c). In d), the two conditions are shown by the conventional 
drawing method of erasing the edge that goes behind something, 
and in e) fillets are used. Fillets display the structure clearly. 


tory experiment with ten naive participants. Eight different 
graphs were tested, of which one was implemented with "per- 
fect" fillets. The other seven graphs were "incomplete" fillets 
or different common node-link graphs lacking visual continu- 
ity. All types of the graphs were implemented in three different 
sizes. The task of the participants was to recognize as fast as 
possible a connection going behind a node. There was only 
one target connection in a graph. A participant performed this 
task 24 times per graph type. 


We found that among these eight graph types, fillets did in- 
deed enable the fastest perception of connection going behind 
a node. This indicates that fillets have inherent properties that 
can help perceiving the structure of node-link graphs and thus 
understanding their contents, as these two are closely inter- 
twined. We plan to carry more experiments to prove the effi- 
ciency of fillets also in more realistic use situations. Results 
from earlier research (Irani & Ware, 2003) indicate that more 
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Figure 2a A random, badly laid out graph rendered using fillets 


Figure 2b (on the cover page) : A random, badly laid out graph 
rendered using fillets and lighting 


Figure 2c. A random, badly laid out graph rendered in the 
conventional way using lines 


natural-looking nodes and links improve users' recall of the 
structure of the graph. We expect that fillets will prove their 
usefulness in tracing connections in graphs but also 
comperehending the structure and possibly the contents of the 
graphs. 


Trani, P. & Ware, C. (2003). Diagramming Information Struc- 
tures Using 3D Perceptual Primitives. ACM Transactions on 
Computer-Human Interaction, Vol. 10, No. 1, March 2003, 
Pages 1-19. 
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1. Introduction 

The authors have been developing an immersive programming 
system called Ougi[6][8] in an immersive virtual environment 
called TEELeX (Tele-Existence Environment for Learning 
exploration)[1]. Immersive programming systems need appro- 
priate 3D visualization of a program. Visual programming lan- 
guages usually use diagrammatical representation and icons. 
For example, graphs are used by many of the visual languages 
to represent control flows and data flows[2][3][4][5]. Icons are 
useful for roughly representing the various types of concrete 
objects; however, the author does not think they visualize rela- 
tionships, or constraints in programming fully. 


The author therefore previously proposed and evaluated the 
use of 2D glyphs[7] to represent inheritance relationships in 
object-oriented programming and a generation method for gen- 
erating them, and proposed the 3D diagrams composed of Jig- 
saw-puzzle-like glyphs to represent syntactical constraints in a 
context-free grammar[10]. Here, the phrase “jigsaw-puzzle- 
like” does not mean an exact match between shapes although 
this constraint representation is similar to matches between the 
pieces of a jigsaw puzzle. The author also proposed an 
auralization method for representing hierarchical inheritance 
relationships[9]. This auralization method generates sound 
passages, called sound glyphs, for nodes in a hierarchy. These 
glyphs can be used to represent hierarchical relationships or 
constraints. The proposed glyph of a node in a hierarchy iden- 
tifies the node, but it does not show the precise position of the 
node in the hierarchy. The following sections describe these 
visual and sound glyphs briefly. 


2. Jigsaw-puzzle-like glyphs for hierarchical relationships 
A new method for generating 2D jigsaw-puzzle-like glyphs 
for inheritance relationships (or hierarchical constraints) was 
devised. In regards to this method, a node in a hierarchy is 
represented as a polygonal glyph. A glyph for a node N is gen- 
erated by replacing the sides of the glyph for the parent node 
of the node N with other polygons. Figure | shows an example 
of a hierarchy. 


A simple recursive method uses one initiator shape and one 
generator shape. For example, a regular rectangular shape is 
used as an initiator and a triangular shape is used as a genera- 
tor. The initiator shape corresponds to the root node of the hi- 
erarchy. The generator shape is used to replace a side of the 
parent glyph. 


The relationships in a hierarchy can be represented by the in- 
clusion relationships of glyphs that have the properties listed 
below. 

¢ (P-1) Child glyphs are included in their parent glyphs. 

¢ (P-2) A node that does not have a hierarchical ancestor- 


descendant relationship with another has a glyph that does 
not include the glyph of the other node, and vice versa. This 
property will be stated such that the glyphs do not include one 
another. 


The simple recursive method is applicable when the number 
of children of each node and the depth of the hierarchy is 
small. However, it is not applicable if the number of children 
is larger than the number of sides. If the hierarchy is deep, the 
differences among the glyphs for nodes at the deeper depths 
are so small as to be indistinguishable. The proposed glyph- 
generation method solves these problems, and can be applied 
to practical hierarchies. 


Before the new glyph-generation method is explained, the po- 
sition of a node in a hierarchy must be explained first as fol- 
lows. A sequence of ordinal numbers at each depth of a node 
can identify the position of the node. In the following, num- 
bers separated by hyphens are used to identify a node in a 
hierarchy. Since the root node is fixed, it is given zero, and its 
direct children are given natural numbers. Nodes A, B, and E 
in Figure 1, for example, can be respectively represented by 
0, 1, and 1-2 because A is the root, B is the first direct child of 
A, and E is the second child of B. This sequence of numbers 
is referred to as the ID sequence (IDS). Note that a single 
number is considered to be a sequence of a single number. 


A(0) 


Level 0 side 


Depth 0 


B(1) 


Depth 1 Level | side 


D(1-1) F (1-3) 


(1-2) 
Depth 2 


H (2-1-1) 


Depth 3 


Figure 1: Visual 2D glyphs in a hierarchy 


Many children 

As explained above, in the simple recursive method, one ini- 
tiator and one generator are used, and one side is chosen to be 
replaced. However, many initiators, generators, and sides can 
be used. Property (P-1) is maintained even if more than one 
side is replaced at the same time. If the shapes or generators 
used for replacement do not include one another, namely, no 
shapes include other shapes, Property (P-2) is also held. 


Deep hierarchy 

In regards to the simple recursive method, sides to be replaced 
are recursively chosen from the sides of their base levels. Un- 
used sides at a level can be used for different depths in the 
hierarchy if different generators at that level are used for the 
sides and if the shapes drawn by the generators do not include 
one another. In this manuscript, a depth refers to the depth of 
a hierarchy and a level refers to the level in a glyph. In Figure 
1, the Level 0 sides of H(2-1-1) are replaced for depths | and 


3. This method increases the distinguishable depth of the hier- 
archy. Using these replacements enables unique glyphs to be 
assigned to nodes in a practical and large hierarchy. 


3. Sound glyphs for hierarchical relationships 

The new method of generating sound glyphs for a hierarchy is 
explained as follows. The relationships in the hierarchy are 
represented by inclusion relationships of sound glyphs. If a 
sound glyph for a subnode B of a node A is a composite sound 
passage of both the sound glyph for A and additional sounds, 
the sound glyph for B is said to include the sound glyph of A. 
In other words, all sounds of sound glyph A are included in 
sound glyph B. 


In a simple generation method, sound glyphs are composed on 
the basis of chords. The idea of sound-glyph generation is basi- 
cally similar to visual glyphs. The position of a node in a hierar- 
chy controls the time positions (timing), pitches, and timbres of 
notes in sound representation. A simple method to satisfy the 
two properties (P-1) and (P-2) is to select the positions of addi- 
tional notes from among the time positions used at a one-level- 
lower depth. Moreover, the pitch of an added note is higher 
than the pitches of notes used at lower depths. 


Each depth is assigned to a different timbre to clarify the depth 
in a hierarchy. A different timbre makes it possible to distin- 
guish notes of the same key. If different timbres are used at 
different depths in a hierarchy, notes of the same key can be 
used at various depths in a hierarchy. This makes it easier to 
generate sound glyphs by satisfying (P-2). 


An example hierarchy is shown in Figure 2. Node B uses two 
notes. Different nodes at the same depth in this hierarchy are 
distinguished by melodies. The sound glyph of Node E is made 
by adding one note to the sound glyph of Node B. 
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Figure 2: Sound glyphs in a hierarchy (musical rests are omitted) 


4. Jigsaw-puzzle-like 3D glyphs for syntactical constraints 
Syntactical relationships can be given visual representation by 
using jigsaw-puzzle-like 3D glyphs that have convex and con- 
cave shapes. A production rule in a context-free grammar is rep- 
resented by a stretchable board shape, as shown in Figure 3. 


The left-hand side of a production rule is represented by a 
convexo-convex shape as shown in Figure 4. In other words, a 
convex shape on a board has the same convex shape on the 
reverse side. Given this fact, we can determine whether two 
boards match by simply looking at their front sides. 


The right-hand side of a production rule is represented by concave shapes or by holes in a board. A match between the convex 
shapes of one board and the concave shapes of another board satisfies a syntactical constraint. When a convex shape is placed in 
a concave shape, the board with the concave shape is stretched, and the size of the board is adjusted, although the size of the 
glyphs is not changed. Nested board shapes have a nested structure, as shown in Figure 5. Figure 6 shows example relationships 


between jigsaw-puzzle-like3D glyphs. 
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Figure 3: Example of a production rule 
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Figure 4: Backside of the convex shape shown in Figure 3 
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Figure 5: Nested boards 
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Figure 6: Example relationships of jigsaw-puzzle-like 3D glyphs 


5. Summary 

Visual and sound glyphs were used to represent constraints as 
inclusion relationships of jigsaw-puzzle-like visual glyphs or 
sound glyphs. The sound glyphs can be used simultaneously 
with other visual representations. This combination should be 
further investigated. The author considers that the examples in 
this manuscript are not necessarily attractive aesthetically. Ac- 
cordingly, methods for generating aesthetically excellent glyphs 
need to be studied and the author believes that the new meth- 
ods will help people understand the abstract relationships vi- 
sually and audibly. Moreover, the proposed glyphs will be ap- 
plied to visualization of relationships or constraints in other 
domains, and they will be useful in many applications if they 
are used in appropriate domains.. 
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Searching the web 

Searching information on the web is becoming a daily activity 
for many. The web is growing at a phenomenal rate; some 
sources say there are currently over 2.5 billion pages available 
and this number is increasing by 7.3 million pages per day 
[1,2]. Despite this complexity current search engines do an 
amazing job. However, search results are mostly presented in 
rank-ordered lists that the user browses to find interesting in- 
formation. These traditional representations are spread over 
multiple pages and the user only views a small proportion of 
the results in a single window. Certainly the search engines 
attempt to display the most relevant information in the top 10 
ranks but experience shows that we still scroll through many 
results and load multiple pages. 


Textual and Graphical depiction 

These text presentations take up a vast amount of the screen 
real estate. Graphical representations, on the other hand, can 
display much more information in a smaller space. Perhaps 
hundreds or even thousands of results could be (abstractly) dis- 
played in the same area as 10 text results. Such abstract depic- 
tions would provide a holistic view of the information that the 
user could refine or zoom into to gather more details from the 
realization [3]. These graphical representations could provide 
the user with a synoptic view of many search results (without 
the need for paging or scrolling), allow clustering operations 
(portraying similarities between search results), allow the user 
to quickly find relevant information and then drill-down into 
specific details. Moreover, such graphical representations could 
display information-rich content including information/statis- 
tics about the sites and pages that the URLs actually address. 
Conversely, users may expect a textual form as they are used 
to browsing and manipulating the search results through these 
interfaces. 


In essence, both representation methods (textual and graphi- 
cal) are valid and have their benefits. Thus, we believe it is 
useful to simultaneously present the search result information 
in both textual and graphical forms. Indeed, by coordinating 
each view together the user would be able to more quickly 
drill-down to the pages that are most interesting and useful. 


Multiple views of search-results 

We have developed some visualization tools that display the 
search result data in multiple linked views, where each win- 
dow provides a dedicated view on the search results. In this 
paper, which is a summary of the work given in [4]. We present 
one system that displays the traditional rank-ordered list of 
URLs with some additional views that detail statistical quanti- 
ties of the sites. Moreover, each view is coordinated together 
such that any enacting user-operation is simultaneously re- 
flected in every view. 


Our search-engine retrieves detailed information about the lo- 
cated sites, first by retrieving the traditional URLs and then 
visiting each site to find this ‘rich’ information. For example, 
as well as storing information about the keywords search terms, 
and retrieving information about the domain-name, URL, text 
snippets of the pages, we retrieve information such as the size 
of the HTML file, number of internal and external links (an- 
chors) on a retrieved page, media type (html, text, images, 
sound), last-modified-date, page structure (e.g. position of the 
media on the page). We display this extended information in 
glyph form. 


Glyph based depiction of search results 

A glyph is a single graphical unit that can portray many vari- 
ables by adapting its properties. An early example was devel- 
oped by Chernoff [5] who represented multi-variable data 
through faces; for example, different values could be repre- 
sented by changes in the shape of the face, length of the eyes, 
nose or mouth, the angle of the eyebrows etc. In our designs 
each search-result is displayed by a single glyph; aspects of 
the appropriate site are represented by different parts of the 
glyph. We have investigated different glyph designs; in this 
paper we present two. 


The first glyph design emphasises the domain of the site of 
each webpage, see Figure |. Each of the domain names is given 
a unique symbol (e.g. the addresses: .country, .com, .edu, .org, 
.net; others are mapped to triangle, circle, square, paralelogram, 
hexagon, plus-symbol, respectively). The rank is allocated a 


Very low ranked .com address 
with a large fle size 


High ranked i 


Lew ranked J2ouriry 
(Ue) with a lange 
file size 


com address 
with mid-wakua 
file size 


Figure 1. This diagram shows the domain glyph representation. 


colour (with a brighter colour representing a higher ranked 
entity) and the size of the page relates to the border-width of 
the glyph (a thicker border representing a larger size). The quan- 
tity of Anchor tags on the page is mapped to position (the ex- 
ternal and internal link quantities are given x and y positions 
respectively). Moreover, the country of origin — if available — 
is depicted by a small flag of the country to the right of the 
glyph. Indeed, glyph placement is important as it allows the 
user to see clusters of similar results, but as subsequent glyphs 
may occlude previous glyphs, we jitter the glyph placement by 
a small random amount in both the x and y coordinates, which 
allows the user to perceive dense regions of similar elements. 


The second glyph design is based on quartiles. It is often beneficial to represent information in quartile ranges, for example 
teachers often allocate students an attainment class (upper, upper-middle, lower-middle or lower ranges). In our usage we 
evaluate whether the quantities are smaller than the lower, median or upper quartile. If they are, then segments around the side 
of a cross are filled in (shown as A,B,C,D in Figure 2). Additional parameters could be represented in further concentric rings. 
We use this technique to represent the measure of external and internal links of a site (the outer and inner segments, respec- 
tively). The colour indicates the relevance like the aforementioned glyph; this is also redundantly visualized as the glyph place- 
ment, however, it is possible to reassign these different variables to each part of the glyph. 


Coordination and Exploration 
In any visualization setup it is important to allow the user to explore and investigate different parameterisations of the visualiza- 


tion. More specifically, it is important to coordinate each of 
| ; ~] Pf the visualizations together such that any user operation is mim- 
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icked in other related views [6]. Such coordination enhances 
the user operation. In our system, when the user highlights 
(brushes) the mouse over one window, so the same elements in 
every other view are simultaneously highlighted. Also, when 
the user clicks on a glyph or a link (in any window) then the 
page is loaded in the browser window, see Figure 3. 

Figure 2. The schematic shows the C-glyph design that allows the 

observer to quickly realize whether the data is within the lower, 

middle or upper quartile ranges. 


Related Work 

The key to success in any such visualization is to develop a 
suitable mapping to exchange the (abstract) search result data 
into an appropriate graphical form. Other researchers have de- 
veloped alternative abstract methods that may be useful in this 
domain. For example, systems such as SeeSoft [7] and WebTOC 
[8] reduce the text itself by abstracting lines of text into hori- 
zontal graphical lines (a technique called greeking). Some systems use dots or coloured areas to display the search result 
information such as Dotfire [9] (used for searching digital libraries) or Sparkler (that visualizes session details) [10]. Other 
systems also realize multiple variables in glyph representations, e.g. Mann [11] uses a technique named TileBars [12] to map 
the position of the keywords and the lengths of the documents (here tilebar information is laid out adjacent to the text informa- 
tion) and systems such as xFind [13] plot glyphs on an x, y axis representing document size and relevance respectively. Finally, 
Cugini et al [14] use different presentation styles including spirals and three-dimensional axis designs. 


bh S 


Summary 

We encourage the use of information-rich realizations espe- 
cially in the area of web-search result visualization. To this 
end we have developed a system that can visualize search-re- 
sult data using glyphs. In our evaluations, apart from being 
distracted by the slowness of the data-gathering, the users liked 
the different visual depictions, and found, in particular, that 
the C-glyph was good at representing sites that contain lists of 
links (often known as luminous sites) that are useful for find- 
ing general information about a subject. 
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Figure 3. The diagram shows a screen shot of the application, in 
this example the user searched for “organic produce”. 
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Abstract 

Ideally, freshman-level students entering technology and engi- 
neering programs should possess an innate or intuitive under- 
standing of the relationship between interacting physical ob- 
jects and the mathematical and graphical fundamentals that 
describe that interaction. Developing and refining an under- 
standing of that relationship is an important foundational prepa- 
ration for students preparing for occupations in these fields. 
Historically, the development of that process has been accom- 
plished predominantly through numerical mathematical means 
that often necessitate presenting important principles to stu- 
dents as numerical or non-visual abstractions. The objective of 
this paper is to describe initial efforts to develop highly graphical 
- visual, spatial, audile, motion-based methods which address 
a vital emerging goal in applied computer graphics instruc- 
tion; problem-solving through 3D computer graphic design- 
simulation. 


1: Introduction 

As part of an introductory course in the Computer Graphics 
Department at Purdue University, the desire to produce prob- 
lem-solvers has lead the faculty to explore ways to use 2-D 
and 3-D models within the course as an avenue for building 
problem-solving skills. This effort was undertaken through the 
need to find inventive ways to solidify certain mathematical, 
geometric, and physics fundamentals in the minds of the stu- 
dents. An important outcome of this activity is to develop stu- 
dent ability to apply these fundamentals in order to analyze, 


explore, and solve spatial and motion oriented problems, which 
can then be displayed and interacted with in graphical form. 


2: A Sample Scenario 

The following sections describe a specific sample project cre- 
ated by students in this course. The sample project that follows 
is based on the design of a physical object intended to function 
as a child's music box. Section 3 describes a laboratory assign- 
ment leading into the project. Section 4 contains the specifica- 
tions for the complete lab project. Section 5 contains visual 
examples of the results of a project. 


3: Sample Weekly Laboratory Assignment 
The Rhythm of Geometry - Designing a Dynamic Solid Model 
with Audio 


Create a solid model of a 'rotating spiked cylinder' for a me- 
chanical music box that is designed to play a simple tune or 
nursery rhyme in one octave (notes C, D, E, F, G, A, B [orB7], 
C). The cylinder is designed to rotate around its axis. As the 
cylinder rotates, the spikes on the cylinder are designed to 'pluck' 
a set of adjacent chimes and play a tune. 


Music Specifications: The tune must be a familiar simple child's 
nursery song that can be played with a one-octave set of chimes. 
The song is to be played with single and harmonic notes as 
demonstrated. Available songs include London Bridge, Chop- 
sticks, Three Blind Mice, Yankee Doodle, Red River Valley, 
I'm a Little Teapot, or Twinkle Twinkle Little Star. One verse 
of the song will be recorded and furnished to you with a play- 
ing time of between 10 and 16 seconds. Digital versions of the 
songs will be available as .wav audio files. 


3D Solid Model: A geometric solid model of the cylinder is to 
be built in inches with the following specifications. Diameter = 
1.25. Length = 2.50. Spikes are to have a diameter of .10 and 
protrude above the surface of the cylinder by .10 inches. Down 
the length of the cylinder each note (C, D, E, F, G, A, B [B7], 
and C) will have its own cross-sectional location. As the cylin- 
der rotates, there must be a spike at the right angular location 
around the cylinder to pluck the correct chime at exactly the 
right time. 


Getting Started: Determine the exact placement of the spikes 
by unrolling the cylinder onto a flat plane. The circumference 
is equal to one complete 360-degree rotation. In the case of 
Mary had a Little Lamb, the circumference also equals 10 sec- 
onds as well as 32 beats for the song. Use math to determine 
the exact angle and location for each of the spikes on the cylin- 
der. Make a valid solid model of the 'tune’. 


4: Project Specification and Format 

Design Problem: A mathematically operated 3D computer 
graphic simulation of a virtual mechanical music box to play 
the song from your musical cylinder. 


Product: Music Box - Operational 3D Virtual Prototype 


Theme: A mechanical-musical toy based on children's musical 
themes. 


Figure 1b Pictorial 


Mechanism: Hand or wheel cranked gear train used 
to rotate and play a mechanical music box mecha- 
nism consisting of a rotating studded cylinder and 
steel pronged chimes. 


Unit/Size: Design in decimal inches. Finished de- 
sign must be no larger than 9 inches in any exterior 
dimension. 


Operating Conditions & Limitations: When the 
driving gear is turned (by crank) or rolled (by wheel) 


Figure 2 Spike dimensions 


at a rate of approximately once per second (+/-), the gear train is put in 
operation which causes the music cylinder to revolve one complete rota- 
tion every X seconds (length of song in seconds) to play the song once. 
Therefore, the length of the motion-based cycle is equal to the length of 
the song. 


Rotational Motion: This is continuous rotational motion. The music box 
must contain at least 2 gear ratio changes requiring a minimum of three 
shafts and four gears to play the song. Sound is generated by a steel comb 
with variable length prongs which are struck by the rotating studs on the 
musical cylinder. The prongs on the comb have a one octave range similar 
to the music cylinder. 


Intermittent Rotational or Linear Motion: This is 'back and forth’ motion. 
Each music box must have at least one intermittent motion that is math- 
ematically tied to the rotational motion of the main gear train. Examples of 
this could be London Bridge going up and down, Yankee Doodle’s hat 
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Figure 3 Inspector Gadget: Gear Train 


bobbing up and down, tails swinging back and forth for Three 
Blind Mice, stars swinging back and forth for Twinkle Twinkle 
Little Star, a rotating tail for Mary Had a Little Lamb, etc. 


Material-Physical Design Conditions in Cavity: Design the 
webbing and bosses inside of the plastic cavity of the music 
box case to mount the music comb; hold the shafts, gears, and 
screws in place with room for parts to move as required. 


Moving Parts Outside of Cavity: External cranks, wheels used 
to operate the music box, as well as, flapping ears, swinging 
mouse tails, etc., must be directly connected to the main drive 
train in the cavity. 


Design of Outer Music Box Case: The Outer Music Box Case 
is to be see-through plastic/acrylic and made in at least two 
pieces with hollow interior cavity for mechanism. Holes and 
small openings need to be designed into the Outer Case to ac- 
commodate hearing the sound, cranks, shafts, wheels, and other 
moving exterior parts. 


Ideation Sketches: a) Interior Cavity grid paper layout assem- 
bly for planning, sizing, and placing gears, shafts, etc. b) De- 
sign sketches used for building 3D exterior or Outer Music 
Box Case model. 


Digital Files: Your 3D musical drum model, digital recording 
of your song, specifications for modeling a comb with steel 
pronged chimes, a Solid Edge assembly model with all 3D parts, 
3D gears from IronCAD, a 3DS MAX file containing an ex- 
pression (mathematically) operated assembly of the Music Box 
with associated music file. 


Primary Final Evaluation Criteria: Projects will be judged us- 
ing two different but complimentary methods. 1. AESTHETIC: 
The project will be judged on how well the case design and 
mechanism arrangement meets the theme of the song as well 
as for visual, simplistic, creative, graphical qualities. 2. TECH- 
NICAL: The creative technical solution of how the gear train 
is integrated into the music box is important. Here, the project 
will be judged on how technically accurate and precisely the 


Figure 4 Inspector Gadget: Assembled Model 


gear train is designed. A complete assembly model must be 
completed in Solid Edge and 3DS MAX. The project must have 
a basic operational gear train by means of expressions in 3DS 
MAX. 


5: Sample Student Project Results 

One of the challenges of this project was to ensure that the 
internal mechanism would actually conform to and fit within 
the intended design of the exterior shell. To illustrate this point, 
images rendered from the completed student design of a music 
box for Inspector Gadget' are shown in figures 3 and 4. 


6: Conclusions 

In conclusion, freshman level design projects of this nature 
will continue to be motivational and challenging for students. 
The integration of sound, basic mechanical principles, motion, 
3D computer graphics, visualization, and basic engineering 
design methods may assist a larger number of students to grasp 
many of the issues involved in the basic mechanical design 
process. 


To avoid repetition and keep students challenged, this project 
will require a new and different theme each semester. With 
modification and refinement, the continued development of'3D 
virtual design/simulation' learning activities will continue to 
be a primary goal in the CGT 116 course at Purdue University. 
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Communication 

Communication is a rich source for analysis of complex socio- 
technical systems. In such environments actors need to com- 
municate to coordinate and synchronize their efforts. Not only 
are these communicated messages essential for successful co- 
operation, but they also provide an observable trace of how the 
involved actors perceived the emerging situation and what de- 
cisions they have made. Therefore, recording and analyzing 
communication are important means of gaining insight into 
the processes involved. 


Unfortunately, communication analysis and other process-trac- 
ing methods can generate huge amounts of data, and analysis 
of audio data based on transcription is time-consuming and 
tedious. Another problem in communication analysis is the need 
for contextual information. To understand the significance of a 
particular message, it is necessary to take information about 
the dynamic situation into account. Considering contextual 
information also makes it possible to analyze why an antici- 
pated message was not sent. There is also a need to manage 
very large data sets, to handle unanticipated and unique ele- 
ments in such data sets, and to maintain a connection between 
the original data and the theories constructed in the course of 
analysis. 


Our approach in tackling these problems is to make the re- 
corded communication visual, together with other types of col- 
lected data from the situation in focus. 


The Attribute Explorer 

To handle the collected communication data we extended the 
Attribute Explorer by Spence and Tweedie (1998). The Attribute 
Explorer is an interactive data presentation tool that employs 
the concept of linked histograms (see Figures | and 2 for ex- 
amples on a military application of the extended Attribute Ex- 
plorer). It provides one histogram for each dimension (or at- 


tribute) of a data set, where the height of each bar corresponds 
to the number of data elements that fall under that interval. By 
applying constraints or selections in one dimension, the corre- 
sponding changes are displayed in the other dimensions. Data 
elements presented in green represent full hits—that is, they sat- 
isfy all constraints applied, or fall within all selections, in all 
dimensions. Shades of gray, from black to white, represent the 
number of dimensions failing. An element is black if it fails in 
only one dimension and white if it fails in all. For each dimen- 
sion in the data set, a constraint can be violated and, therefore, 
the required number of shades of gray equals the number of 
dimensions of the data set. 
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The Attribute Explorer meets some key needs for communica- 
tion analysis in complex socio-technical systems. It accepts 
well-defined, absolute restrictions on each dimension, which 
supports straightforward queries. It encourages exploration by 
enabling dynamic interaction with every dimension and pre- 
senting immediate visual feedback. It provides a view of the 
context at all times as the color-coded histograms give hints on 
where to relax constraints to get hits and where to impose re- 
strictions to narrow the solution space. 


Figure 1; Right, Middle, Left: Communication and context. 
Left: An example of a simple query using only one dimension, 
sender, of the Attribute Explorer: Military unit QJ is selected 
in the sender dimension and all communication initiated by 
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Figure 2 


this unit is shown in a list below the graph. Middle: A map 
view synchronized to the Attribute Explorer. When going 
through the communication, the map will show us how the 
units were situated at the time. Right: A synchronized graph 
view that shows the accumulated communication concerning 
intelligence (red) and own units (blue). 


Figure 2. This example uses five different dimensions of com- 
munication and concerns identification of regular reports. By 
selecting appropriate limits on the sender, receiver, classifica- 
tion, and time dimension, the green elements make it visually 
clear how the company TJ regularly reports to its supervising 
officers during the selected time period. The length dimension 
shows that the reports ranged from 4 seconds to | minute and 
20 seconds in length. The color-coding of the other elements 
gives us many hints on other possible areas of interest. For 
example, since there are no black elements outside the con- 
straints in the receiver dimension, we can conclude that the TJ 
only reported to its supervising officers. 


Summary 

By using methods that make the handling and navigation among 
process-tracing data manageable, communication analysis can 
be an effective tool. The ability to visually explore the data 
sets, and approach them in different ways, gives opportunities 
to both answer questions we want to ask, and also to find the 
questions we should ask. We also think visual exploratory tech- 
niques will prove to be useful in better understanding the na- 
ture of communication in complex socio-technical systems to 
be able to derive metrics that can capture the inherent com- 
plexity. 
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